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Abstract 

In this paper, we examine structured tensors which have sum-of-squares (SOS) tensor 
decomposition, and study the SOS-rank of SOS tensor decomposition. We first show that 
several classes of even order symmetric structured tensors available In the literature have SOS 
tensor decomposition. These include positive Cauchy tensors, weakly diagonally dominated 
tensors, Bo-tensors, double B-tensors, quasi-double Bo-tensors, MBo-tensors, B'-tensors, ab¬ 
solute tensors of positive semi-definite Z-tensors and extended Z-tensors. We also examine 
the SOS-rank of SOS tensor decomposition and the SOS-width for SOS tensor cones. The 
SOS-rank provides the minimal number of squares in the SOS tensor decomposition, and, for 
a given SOS tensor cone, its SOS-width is the maximum possible SOS-rank for all the tensors 
in this cone. We first deduce an upper bound for general tensors that have SOS decomposition 
and the SOS-width for general SOS tensor cone using the known results in the literature of 
polynomial theory. Then, we provide an explicit sharper estimate for the SOS-rank of SOS 
tensor decomposition with bounded exponent and identify the SOS-width for the tensor cone 
consisting of all tensors with bounded exponent that have SOS decompositions. Finally, as ap¬ 
plications, we show how the SOS tensor decomposition can be used to compute the minimum 
B’-eigenvalue of an even order symmetric extended Z-tensor and test the positive definiteness 
of an associated multivariate form. Numerical experiments are also provided to show the ef¬ 
ficiency of the proposed numerical methods ranging from small size to large size numerical 
examples. 
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1 Introduction 


Tensor decomposition is an important research area, and it has found numerous applications in 
data mining [181 [SHI US], computational neuroscience [11] [5], and statistical learning for latent 
variable models [T]. An important class of tensor decomposition is sum-of-squares (SOS) tensor 
decomposition. It is known that to determine a given even order symmetric tensor is positive 
semi-definite or not is an NP-hard problem in general. On the other hand, an interesting feature 
of SOS tensor decomposition is checking whether a given even order symmetric tensor has SOS 
decomposition or not can be verified by solving a semi-definite programming problem (see for 
example M), and hence, can be validated efficiently. SOS tensor decomposition has a close 
connection with SOS polynomials, and SOS polynomials are very important in polynomial theory 
[smiiiiiiiMiiii] and polynomial optimization [T1I1I1I11I11ISS1I12]. It is known that an even 
order symmetric tensor having SOS decomposition is positive semi-definite, but the converse is not 
true in general. Recently, a few classes of structured tensors such as B tensors [38] and diagonally 
dominated tensor have been shown to be positive semi-definite in the even order symmetric 
case. It then raises a natural and interesting question: Will these structured tensors admit an SOS 
decomposition? Providing an answer for this question is important because this will enrich the 
theory of SOS tensor decomposition, achieve a better understanding for these structured tensors, 
and lead to efficient numerical methods for solving problems involving these structured tensors. 

In this paper, we make the following contributions in answering the above theoretical question 
and providing applications on important numerical problems involving structured tensors: 

(1) We first show that several classes of symmetric structured tensors available in the literature 
have SOS decomposition when the order is even. These classes include positive Cauchy 
tensors, weakly diagonally dominated tensors, Ro-tensors, double R-tensors, quasi-double 
Bo-tensoTS, MBo-tensois, i?-tensors, absolute tensors of positive semi-definite Z-tensors and 
extended Z-tensors. 

(2) Secondly, we examine the SOS-rank for tensors with SOS decomposition and the SOS-width 
for SOS tensor cones. The SOS-rank of tensor A is defined to be the minimal number of the 
squares which appear in the sums-of-squares decomposition of the associated homogeneous 
polynomial of A, and, for a given SOS tensor cone, its SOS-width is the maximum possible 
SOS-rank for all the tensors in this cone. We deduce an upper bound for the SOS-rank of 
general SOS tensor decomposition and the SOS-width for the general SOS tensor cone using 
the known result in polynomial theory [Ij. We then provide a sharper explicit upper bound 
of the SOS-rank for tensors with bounded exponent and identify the exact SOS-width for 
the cone consists of all such tensors with SOS decomposition. 

(3) Finally, as applications, we show how the derived SOS tensor decomposition can be used to 
compute the minimum i/-eigenvalue of an even order symmetric extended Z-tensor and test 
the positive definiteness of an associated multivariate form. Numerical experiments are also 
provided to show the efficiency of the proposed numerical method ranging from small size to 
large size numerical examples. 

The rest of this paper is organized as follows. In Section 2, we recall some basic definitions 
and facts for tensors and polynomials. We also present some properties of SOS tensor cone and 
its duality. In Section 3, we present SOS decomposition property for various classes of structured 
tensors. In Section 4, we study the SOS-rank of SOS tensor decomposition and SOS-width for 
a given SOS tensor cone. In particular, we examine SOS tensor decomposition with bounded 
exponents and the SOS-width of the cone constituted by all such tensors with SOS decomposition. 
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and provide their sharper explicit estimate. In Section 5, as applications for the derived SOS 
decomposition of structure tensors, we show that the minimum TJ-eigenvalue of an even order 
extended Z-tensor can be computed via polynomial optimization technique. Accordingly, this also 
leads to an efficient test for positive definiteness of an associated multivariate form. Numerical 
experiments are also provided to illustrate the significance of the result. Final remarks and some 
questions are listed in Section 6. 

Before we move on, we briefly mention the notation that will be used in the sequel. Let M" be 
the n dimensional real Euclidean space and the set consisting of all positive integers is denoted by 
N. Suppose m,n € N are two natural numbers. Denote [n] = {1,2,-- - ,n}. Vectors are denoted 
by bold lowercase letters i.e. x, y, • • •, matrices are denoted by capital letters i.e. A, i?, • • •, and 
tensors are written as calligraphic capitals such as A, T, • • • . The i-th unit coordinate vector in 
R” is denoted by ei. If the symbol | ■ | is used on a tensor A = (aii...i„,)i<q<n, j = 1, • ‘ i it 
denotes another tensor \A\ = j = 1, - ■ ■ ,m. 


2 Preliminaries 


A real mth order n-dimensional tensor A = (aiiia -im) is a multi-array of real entries 
where ij € [n] for j £ [m]. If the entries are invariant under any permutation of their 

indices, then tensor A is called a symmetric tensor. In this paper, we always consider symmetric 
tensors defined in R". The identity tensor I with order m and dimension n is given by = 1 

\i ii = ■ ■ ■ = im and = 0 otherwise. 

We first fix some symbols and recall some basic facts of tensors and polynomials. Let m, n £ 
N. Consider Sm,n '■= {A : A is an mth-order n-dimensional symmetric tensor}. Clearly, Sm,n is 
a vector space under the addition and multiplication defined as below: for any t £ R, A = 
(nq... 2 ^)i<qj... and ^ — (6^,^...^^)i< 2 i,■■■ 

A + B = (dii-.-i,,, + b 

"il "'iTn and tA= (toq...i^)i<q,... 


For each A, £ Sm,,n, we define the inner product by 

n 

(A,S) := 




bi. ...f 


The corresponding norm is defined by ||A|| = ((A, A))^^^ = [ ^ (aq...i^)^ 1 .For a vector 

X £ R", we use Xi to denote its Ah component. Moreover, for a vector x £ R”, we use x™ to 
denote the rnth-order n-dimensional symmetric rank one tensor induced by x, i.e., 


‘ ‘ * ^ A; * * * ; ^ {1; * * * ; n}. 


We note that an rnth order n-dimensional symmetric tensor uniquely defines an mth degree 
homogeneous polynomial Ja on R”: for all x = (xi, • • • ,XnY' £ R", 

— Ax — ^ ^ ^^2 * * * 

Conversely, any mth degree homogeneous polynomial function / on R" also uniquely corresponds 
a symmetric tensor. Furthermore, a tensor A is called positive semi-definite (positive definite) if 
/.a(x) > 0 (/^(x) > 0) for all x £ R" (x £ R"\{0}). 

We now recall the following definitions on eigenvalues and eigenvectors for a tensor [1H1I3Z]- 
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Definition 2.1 Let C be the complex field. Let A = (aiiia-'-im) order m dimension n tensor. 

A pair (A,x) £ C x C” \ {0} is called an eigenvalue-eigenvector pair of tensor A, if they satisfy 

where Ax^~^ and are all n dimensional column vectors given by 

and x[™-il = ..., G R". 

If the eigenvalue A and the eigenvector x are real, then A is called an il-eigenvalue of A and x is its 
corresponding il-eigenvector m- An important fact which will be used frequently later on is that 
an even order symmetric tensor is positive semi-definite (definite) if and only if all il-eigenvalues 
of the tensor are nonnegative (positive). 

Suppose that m is even. In (12.IL if /^(x) is a sums-of-squares (SOS) polynomial, then we 
say A has an SOS tensor decomposition (or an SOS decomposition, for simplicity). It is clear 
that a tensor with SOS decomposition and an SOS polynomial must have even degree. If a given 
tensor has SOS decomposition, then the tensor is positive semi-definite, but not vice versa. Next, 
we recall a useful lemma which provides a test for verifying whether a homogeneous polynomial is 
a sums-of-squares polynomial or not. To do this, we introduce some basic notions. 

For all X G M", consider a homogeneous polynomial /(x) = /aX“ with degree m (m is an 
even number), where a = (oi, • • • , a„) G (N U {0})”, x“ = and |q;| := 

Let /m,i be the coefficient associated with x™. Let ei be the zth unit vector and let 

Llf = {a = (oi, • • • , a„) G (N U {0})" : /a 0 and a ^ mei, f = I, • • • , n}. (2-2) 

Then, / can be decomposed as /(x) = fm,ix'tf^ /ax“. Recall that 2N denotes the 

set consisting of all the even numbers. Define 

n 

/W = XI frn.iXT - X 

i—1 



Ax^-^ = 


E 


where 

Af :={«= (ai,... ,a„) G D/ : /„ <0or (2NU{0})”}. (2.3) 

Lemma 2.1 Corollary 2.8] Let f be a homogeneous polynomial of degree m, where m is an even 
number. If f is a polynomial which always takes nonnegative values, then f is a sums-of-squares 
polynomial. 

SOS tensor cone and its dnal cone 

In this part, we study the cone consisting of all tensors that have SOS decomposition, and its dual 
cone m- We use SOSm,n to denote the cone consisting of all order m and dimension n tensors, 
which have SOS decomposition. The following simple lemma from m gives some basic properties 
of SOSm,„. 

Lemma 2.2 (cf. [T3]) Let m, n G N and m be an even number. Then, SOS^,™ o closed convex 
cone with dimension at most I{m,n) = 


4 


For a closed convex cone C, we recall that the dual cone of C in Sm,n is denoted by C® and 
defined by C® = {A G Sm,n ■ {A,C) > 0 for all C G C}. Let M = £ * 5 'm,n- We also 

define the symmetric tensor sym(Af (Si M) G S2m,n by 

sym(Af ( 8 ) ^ 771*^,... ■ ■ ■ Xi^Xj^ 

dm<n 

Moreover, in the case where the degree to = 2 , SOS2,n and its dual cone are equal, and both reduce 
to the cone of positive semidefinite (n x n) matrices. Therefore, to avoid triviality, we consider the 
duality of the SOS tensor cone SOS^.n in the case where to is an even number with to > 4 . 

Proposition 2.1 (Duality between tensor cones) Let n G N and m be an even number with 
TO > 4 . Then, we have SOS® „ = {A G Sm,n '■ (M,sym(A 4 (S At)) > 0 , V At G ^^,n} 
SOS„,„ g SOS® 

Proof. We define SOS^ „ to be the cone consisting of all mth-order n-dimensional symmetric 
tensors such that /^(x) := (A, x™) is a polynomial which can be written as sums of finitely 
many homogeneous polynomials. We now see that indeed SOS^ „ = SOS^.n- Clearly, SOS^ „ C 
SOSm.ra- To see the reverse inclusion, we let A G SOSm,n- Then, there exists I G N and /i, • • • , fi 
are real polynomials with degree at most ^ such that (A,x"*) = X]i=i In particular, for 

alH > 0 , we have 

i 

{A,x”^) = {A, {tKr) = '£Mtxf 

i^l 

Dividing on both sides and letting t -d +00, we see that (A, x'") = X]i=i/*.—(^)^’ where 
/i,™ is the ^th-power term of fi, i = I,-- - This shows that A G SOS^_„. Thus, we have 
SOS^ „ = SOSm.n- It then follows that 

(SOS^,„)® = (SOSJ:, J® = MG 5 ™.„:(AC)>OforallCGSOS^,„} 

I 

= {Ag Sm,n ■ {A,C) > 0 for all C = ^ sym(A 4 j 8 Mi), 

i=l 

Afj G S,n: i — 1 ;**' 

= {A G Sm,n '■ {A, sym(Af 8 A 4 )) > 0 for all A 4 G 

We now show that SOS^.n % SOS® „ if to > 4 . Let /(x) = x\ + x\ + |;x| + 6x^X2 + 6xfx§ + 6x2X§ 
and let A G £'4,3 be such that Ax^ = /(x). Then, A has an SOS decomposition and = 

A2,2,2,2 = 1 , A3,3,3,3 = Ai,1,3,3 = Ai,i,2,2 = A2,2,3,3 = 1 - We now See that A ^ SOS® „. 
To see this, we only need to find M G 82,3 such that (A, sym(M 8 M)) < 0 . To see this, let 
M = diag(l, 1 , — 4 ). Then, sym(M 8 M)x^ = (x^Mx)^ = (xf + X2 — 4x3)^. Direct verification 
shows that sym(M 8 M)x^ = xf + X2 + 16 x| + 2 x^x 1 — 8x^X3 — 8x3X3. So, sym(M 8 M)i,1,1,1 = 
sym(M 8 M)2,2,2,2 = 1 , sym(M 8 M)3,3,3,3 = 16 , sym(M 8 Ar)i,i,2,2 = sym(M 8 Af)i,1,3,3 = 
sym(M 8 Af)2,2,3,3 = ~|- Therefore, 

and the desired results hold. □ 


(A, sym(M 8 M)) = 1 + 1 + - • 16 ■ 


Question: It is known from polynomial optimization (see [ 22 l Proposition 4 . 9 ] or [ 2 T]) that 
the dual cone of the cone consisting of all sums-of-squares polynomials (possibly nonhomogeneous) 
is the moment cone (that is, all the sequence whose associated moment matrix is positive semi¬ 
definite). Can we link the dual cone of SOS^,™ to the moment matrix? Can the membership 
problem of SOS® „ be solvable in polynomial time? 
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3 SOS Decomposition of Several Classes of Structured Ten¬ 
sors 

In this section, we examine the SOS decomposition of several classes of symmetric even order 
structured tensors, such as positive Cauchy tensor, weakly diagonally dominated tensors, Bq- 
tensors, double S-tensors, quasi-double i?o-tensors, MSo-tensors, H-tensors, absolute tensors of 
positive semi-definite Z-tensors and extended Z-tensors. 

3.1 Characterizing SOS decomposition for even order Cauchy tensors 

Symmetric Cauchy tensors was first studied in [5]. Some checkable sufficient and necessary condi¬ 
tions for an even order symmetric Cauchy tensor to be positive semi-definite or positive definite 
were provided in [2, which extends the matrix cases established in [lOj . 

Let c = (ci, C 2 , • • • , c„)^ € K” with +Ci^-\ - \-Ci^ ^ 0 for alHj G {1,..., n}, j = 1,..., m. 

Let the real tensor C = be defined by 


1 


j G H, ij G [n\. 


Cil + Ci^ + ' ' ' + Cim 


Then, we say that C is a symmetric Cauchy tensor with order m and dimension n or simply a 
Cauchy tensor. The corresponding vector c G R" is called the generating vector of C. 

To establish the SOS decomposition of Cauchy tensors, we will also need another class of tensors 
called completely positive tensor, which has an SOS tensor decomposition in the even order case. 

Tensor A is called a completely decomposable tensor if there are vectors G R", j G [r] 
such that A can be written as sums of rank-one tensors generated by the vector x^-, that is. 





If Xj G R" for all j G [r], then A is called a completely positive tensor [39] . It was shown that 
a strongly symmetric, hierarchically dominated nonnegative tensor is a completely positive tensor 

m- 

We now characterize the SOS decomposition and completely positivity for even order Cauchy 
tensors. 

Theorem 3.1 Let c = (ci, C 2 , • • • , G R" with + Ci^ -\ - -|- ^ 0 /or all ij G {!,..., n}, 

j = 1,..., m. Let C be a Cauchy tensor generated by c with even order m and dimension n. Then, 
the following statements are eguivalent. 

(i) the Cauchy tensor C has an SOS tensor decomposition; 

(ii) the Cauchy tensor C is positive semi-definite; 

(iii) the generating vector of the Cauchy tensor Ci, i G [n], are all positive; 

(iv) the Cauchy tensor C is a completely positive tensor. 

Proof. Since m is even, by definitions of completely positive tensor, SOS tensor decomposition 
and positive semi-definite tensor, we can easily obtain (i) (ii) and (iv) (i). By Theorem 2.1 
of |2|, we know that C is positive semi-definite if and only if > 0,i G [n], and hence, (ii) (iii) 
holds. So, we only need to prove (iii) (iv), that is, any Cauchy tensors with positive generating 
vector is completely positive. 
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Assume (iii) holds. Then, for any x € K”, 



By the definition of Riemann integral, we have 


ex’" 




Let Ck be the symmetric tensor such that 






= ^(V,x))'", 

i=i 


where 



i = I,-- - ,k. 


Let CDm,ra denote the set consisting of all completely decomposable tensor with order m and 
dimension n. From m Theorem 1], is a closed convex cone when m is even. It then 

follows that C = limfc_).oo Cfc is also a completely positive tensor. □ 


3.2 Even order symmetric weakly diagonally dominated tensors have 
SOS decompositions 

In this section, we establish that even order symmetric weakly diagonally dominated tensors have 
SOS decompositions. Firstly, we give the definition of weakly diagonally dominated tensors. To do 
this, we introduce an index set A _4 associated with a tensor A. Now, let A be a tensor with order 
m and dimension n, and let be its associated homogeneous polynomial such that /yi(x) = Ax’". 
We then define the index set as A/ with / = /^, as given as in (12.31) . 


Definition 3.1 We say A is a diagonally dominated tensor if, for each i = 1, - ■ ■ ,n, 


an-.-i ^ ^ ^ 


I ■ 
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We say A is a weakly diagonally dominated tensor if, for each i = 1, - ■ ■ ,n, 

E I- 

(i.i2 ■ 

Clearly, any diagonally dominated tensor is a weakly diagonally dominated tensor. However, the 
converse is, in general, not true. 

Theorem 3.2 Let A be a symmetric weakly diagonally dominated tensor with order m and di¬ 
mension n. Suppose that m is even. Then, A has an SOS tensor decomposition. 


Proof. Denote / = {(*,••• ,i) \ 1 < i < n}. Let x G M". Then, 


- ^ ^ ^22 - 



im^il 

2^22 • 

■ ■ ^im 

2=1 


in 





n 

/ 



\ 



= E 

^^22---2 

y i®M2 

...J 


+ 

2=1 

V 

(»2-- 

■ ,im)eA^ 

) 



Tl 

E 


E 

0>ii2 ■ ■ Am 1^2 

E 

^i\i2"Am^'i'l^n * * * 

2=1 

( 

^2- 

•i,i2 

■■ ,im)eA^ 


(21,--- 

^rr.)0 

n 

( 






= E 

dii-'-i 

y ^ i®M 2 

..jl 

xT 


2=1 

\ 

(^2" 


} 



n 




n 



+E 

E 

\^ii2-"im \^i 

+ E 

^ ^ 0^112" Am^T^n * * * ^2 


i=l 

(i,i 2 ■ 


i=l 


Define 


E E 




= E E 


\au. 


(i,i2 ■■ ■ 


E E 


^112 "Am ^i^i2 ' ' * ^'im ‘ 


We now show that ft. is a sums-of-squares polynomial. 

To see ft is indeed sums-of-squares, from Lemma im it suffices to show that 


■= E E 


m 


ll2"Am \^i 


-E E 


1^112" Am \^i^i2 ' * * ^'i-n 


2=1 (i2"-im)9^(i-"i) 


2=1 (i2"Am)9^(i-"i) 

(iA 2 -" 


is a polynomial which always takes nonnegative values. As ft is a homogeneous polynomial with 
degree m on K”, let H be a symmetric tensor with order m and dimension n such that ft(x) = Hx™. 
Since A is symmetric, the nonzero entries of Tl are the same as the corresponding entries of A. 
Now, let A be an arbitrary iL-eigenvalue of Tl, from the Gershgorin Theorem for eigenvalues of 
tensors [3Zl, we have 


E 




(i,i2 -- .im)eA_4 


A- 


< 






So, we must have A > 0. This shows that all i7-eigenvalues of T-L must be nonnegative, and so, T-L 
is positive semi-definite m- Thus, /i is a polynomial which always takes nonnegative values. 
Now, as Al is a weakly diagonally dominated tensor and m is even. 


E 


/ 

dii-.-i 

V 


E 






is an SOS polynomial. Moreover, from the definition of A^, for each (ii • • • im) ^ A^, > 0 

and Xi^ ■ ■ ■ Xi^ is a squares term. Then, 


E 


E 


, XjXj_. 


■ • 


is also a sums-of-square polynomial. Thus, Al has an SOS tensor decomposition. □ 

As a diagonally dominated tensor is weakly diagonally dominated, the following corollary follows 
immediately. 


Corollary 3.1 Let A be a symmetric diagonally dominated tensor with even order m and dimen¬ 
sion n. Then, A has an SOS tensor decomposition. 


3.3 The absolute tensor of an even order symmetric positive semi-definite 
Z-tensor has an SOS decomposition 

Let A be an order m dimension n tensor. If all off-diagonal elements of A are non-positive, then 
A is called a Z-tensor [IS]. A Z-tensor A = can be written as 

A = V-C, (3.1) 

where 21 is a diagonal tensor where its ith diagonal elements equals i = 1,..., n, and C is 

a nonnegative tensor (or a tensor with nonnegative entries) such that diagonal entries all equal to 
zero. We now define the absolute tensor of A by 

|Al| = |21|+C. 

Note that all even order symmetric positive semi-definite Z-tensors have SOS decompositions 
[mn], a natural interesting question would be: do all absolute tensors of even order symmetric 
positive semi-definite Z-tensors have SOS decompositions? Below, we provide an answer for this 
question. 

Theorem 3.3 Let A be a symmetric Z-tensor with even order m and dimension n defined as in 
If A is positive semi-definite, then |Al| has an SOS tensor decomposition. 

Proof. Let A = be a symmetric positive semi-definite Z-tensor. From (13.1|) . we have 

A = V — C, where 21 is a diagonal tensor where the diagonal entries of 21 is di := ai,,,i,i € [n] 
and C = (cqi 2 ...i„) is a nonnegative tensor with zero diagonal entries. Define three index sets as 
follows: 

2 —{(^7^25*** 7^m) ^ [^] I h — ^2 — *** — Imf 1 
D — ^ [^] I 7 ^ ^ and (h,^2;*** ^ If 1 

A ={(ii, Z 2 , • • • ,im)&^ I >0 least one index in(ii,i 2 ,‘‘‘ Am) exists odd times}. 
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Let /(x) = |^|x™ and define a polynomial / by 

n 

f (^) “ ^ ^ diXj^ ^ ^ \ ^ii ^i2 ' * * ■ 

^—1 (n,^2,--- ,^Tn)£A 

From Lemma o to see polynomial /(x) = |^|x"* is a sums-of-squares polynomial, we only need 
to show that / always takes nonnegative value. To see this, as A is positive semi-definite, we have 
di > 0. Since > 0, ij € [n], j € [m], it follows that 


n 


■ Y^dtxT 

- E 

^2i 22 ■ ■’^m ^^2 * * * 


i^l 


06A 


n 

-Y^dtxT 

- E 

"■'im ^*2 * ’ * 

z ^ ^ ^2122 



Oen 

( 21 , 22 ,"' ,2m)£S^\A 


E 

^2l 22 • •’27^ ^*2 * * * 



> 0 . 

Here, the last inequality follows from the fact that m is even, A is positive semi-definite and 
Xi^Xi 2 • ■ ■ Xi^ is a square term if (ii, ^ 2 , • • • , im) G H\A. Thus, the desired result follows. □ 

3.4 SOS tensor decomposition for even order symmetric extended Z- 
tensors 

In this subsection, we introduce a new class of symmetric tensor which extends symmetric Z- 
tensors to the cases where the off-diagonal elements can be positive, and examine its SOS tensor 
decomposition. 

Let / be a polynomial on R" with degree m. Let fm,i be the coefficient of / associated with 
cc™, i & [n]. We say / is an extended Z-polynomial if there exist s G N with s < n and index sets 
Tz C {1, • • • , n}, / = 1, • • • , s with T; = {1, • • • , n} and Tz^ n Tzj = 0 for all h ^ I 2 such that 

n s 

/W = frn,iXT + X! 

2 = 1 1 — 1 Oil 

where 

Hz = {a G ([n] U {0})” : |a| = m,x“ = Xi^^x^^ ■ ■ -Xi^, {ii, • • • ,im} Q Lz, and a ^ mei, i= 1, - ■■ ,n} 
for each / = 1, • • • , s and either one of the following two conditions holds: 

( 1 ) fat = 0 for all but one ai € 

(2) fai < 0 for all oz G Hz. 

We now say a symmetric tensor A is an extended Z-tensor if its associated polynomial />t(x) = 
Ax"^ is a an extended Z-polynomial. 

From the definition, it is clear that any Z-tensor is an extended Z-tensor with s = 1 and 
Ti = {l,---,n}. On the other hand, an extended Z-tensor allows a few elements of the off- 
diagonal elements to be positive, and so, an extended Z-tensor need not to be a Z-tensor. For 
example, consider a symmetric tensor A where its associated polynomial />t(x) = Ax"^ = Xi + 
X 2 + x% + x% + 4 ,x\x2 + &x\x\. It can be easily see that A is an extended Z-tensor but not a Z-tensor 


10 


(as there are positive off-diagonal elements). In [32], partially Z-tensors are introduced. There is 
no direct relation between these two concepts, except that both of them contain Z-tensors. But 
they do have intersection which is larger than the set of all Z-tensors. Actually, the example just 
discussed is not a Z-tensor, but it is an extended Z-tensor and a partially Z-tensor as well. 

We now see that any positive semi-definite extended Z-tensor has an SOS tensor decomposition. 
To achieve this, we recall the following useful lemma, which provides us a simple criterion for 
determining whether a homogeneous polynomial with only one mixed term is a sum of squares 
polynomial or not. 

Lemma 3.1 ^ Let bi, 62 , • • • , > 0 and d € N. Let oi, 02 , • • • , a„ G N be such that 

Consider the homogeneous polynomial /(x) defined by 

/(x) = dixf -b • • • -b b^xl^ - •••<". 

Let fj,Q = “^dYlai^o i<i<n(^)^- Then, the following statements are eguivalent: 

(i) f is a nonnegative polynomial i.e. /(x) > 0 for all x G K”; 

(ii) either \p,\ < p.o or p, < and all Oi are even; 

(iii) / is an SOS polynomial. 

Theorem 3.4 Let A be an even order positive semi-definite extended Z-tensor. Then, A has an 
SOS tensor decomposition. 

Proof. Let /.a(x) = Ax™. As A is a positive semi-definite symmetric extended Z-tensor, there 
exist s G N and index sets F/ C {1, • • • , n}, I = 1, - ■ ■ ,s with F; = {1, • • • ,n} and Fj^ flF/^ = 0 
for all 1 1 1 2 such that for all x G K" 

n s 

f{K) = Y,u^xT+Yl E 

i—l 1 — 1 0.1 

such that, for each Z = 1 , • • • , s, either one of the following two condition holds: ( 1 ) fa, = 0 for all 

but one ai £ fli; (2) fa, < 0 for all ai Gfli. Define, for each Z = 1 , • • • , s, 

■= 

ler, aieo, 

It follows that each hi is an extended Z-polynomial. Moreover, from the construction, ~ Ia 

and so, infxgR" ^z(^) = 0- Note that each hi is also a homogeneous polynomial, and hence 

infxgK" hifx.) < 0 . Noting that each hi is indeed a polynomial on (azjjigri , Uf=i ‘ ‘ ‘ i 

and Fjj fl Fj^ = 0 for all h 7 ^ I 2 , we have infxeR" J2i=i hifx.) = J2i=i infxGR" hifx.). This enforces 
that infx£R" Ziz(x) = 0. In particular, each hi is a polynomial which takes nonnegative values. We 
now see that hi, 1 < Z < s, are SOS polynomial. Indeed, if fa, = 0 for all but one ai G Lli, then 
hi is a homogeneous polynomial with only a mixed term, and so. Lemma 13.11 implies that hi is 
a SOS polynomial. On the other hand, if fa, < 0 for all ai G O/, hi corresponds to a Z-tensor, 
and so, hi is also a SOS polynomial in this case because any positive semi-definite Z-tensor has 
an SOS tensor decomposition M- Thus, = X]z*=i SOS polynomial, and hence the 

conclusion follows. □ 

Remark 3.1 A close inspection of the above proof indicates that we indeed shows that the asso¬ 
ciated polynomial fA{^) = Ax™ satisfies f^ = where each hi is an SOS polynomial in 
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3.5 Even order symmetric i?o-tensors have SOS decompositions 

In this part, we show that even order symmetric Bq tensors have SOS tensor decompositions. 
Recall that a tensor A = with order m and dimension n is called a Bo-tensor [35] if 

n 

^ ^ 0'222---2m — 

.im = l 

and 

1 " 

m—l ^ tor 8-11 (j2i ' ' ' Am) ' , *)• 

To establish that a Bo-tensor has an SOS tensor decomposition, we first present the SOS tensor 
decomposition of the all-one-tensor. We say £ is an all-one-tensor if with each of its elements of £ 
is equal to one. 


Lemma 3.2 Let £ be an even order all-one-tensor. Then, £ has an SOS tensor deeomposition. 


Proof. Let £ 
one has 


be an all-one-tensor with even order m and dimension n. For all x £ R", 

£x-“ = y 


^2122 • • ^^2 * * * 
— ^ ^ ^21^22 ‘ ‘ * ^i-m 

= {xi -h X2 

> 0 , 


which implies that £ has an SOS tensor decomposition. □ 

Let J C [nj. £'^ is called a partially all-one-tensor if its elements are defined such that = 

1, ii,i 2 , ■ ■ ■ ,im & J and = 0 for the others. Similar to Lemma 3.2, it is easy to check that 

all even order partially all-one-tensors have SOS decompositions. 

We also need the following characterization of Bo-tensors established in [35] ■ 


Lemma 3.3 Suppose that A is a Bo-tensor with order m and dimension n. Then either A is a 
diagonally dominated symmetric M-tensor itself, or we have 


A = M + Y,hk£'’A 

k=l 


where M. is a diagonally dominated symmetric M-tensor, s is a positive integer, hk > 0 and 
Jk Q {1, • • • , n}, for fc = 1, • • • ,s, and Ji = 0, for k ^ 1. 

From Theorem 13.21 Lemma 13^ and Lemma [3.31 we have the following result. 


Theorem 3.5 All even order symmetrie Bo-tensors have SOS tensor decompositions. 


Before we move on to the next part, we note that, stimulated by Bo-tensors in [38] . symmet¬ 
ric double B-tensors, symmetric quasi-double Bo-tensors and symmetric MBo-tensors have been 
studied in [241 [35] . Below, we briefly explain that, using a similar method of proof as above, these 
three classes of tensors all have SOS decompositions. To do this, let us recall the definitions of 
these three classes of tensors. 
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For a real symmetric tensor B = 


) with order m and dimension n, denote 


A (6) 


max {0, b 

h,--- 




}; 


A.(S)= ^ mB) - b,,,...,J; 

n,--- Jm)^/ 

A}(s) = A,(e)-(A(e)-A,....i), 

As defined in [24l Definition 3], B is called a double B-tensor if, bii...i > Pi{B), for all i G [n] and 
for all i,jG [n],i j such that 

A,(S) 

and 

- P.mibn-, - A(S)) > MB)A,{B). 

If bii-.-i > j3i{B), for all i G [n] and 

(bu-. - - PAB) - ^]{B)) > {P,{B) - b,,...,)ApB), 

then tensor B is called a quasi-double Bo-tensor (see Definition 2 of [25]). 

Let A = (aiii 2 " jm) such that 


aiii 2 -im =^iii 2 -im - Pii{B), for all ii G [n]. 

If A is an M-tensor, then B is called an MBp-tensor (see Definition 3 of [25]). It was shown in 
[25] that all quasi-double Bp-tensors are MBp-tensors. 

In [24], Li et al. proved that, for any symmetric double B-tensor B, either B is a doubly strictly 
diagonally dominated (DSDD) Z-tensor, or B can be decomposed to the sum of a DSDD Z-tensor 
and several positive multiples of partially all-one-tensors (see Theorem 6 of [24]). From Theorem 4 
of |24j . we know that an even order symmetric DSDD Z-tensor is positive definite. This together 
with the fact that any positive semi-definite Z-tensor has an SOS tensor decomposition m implies 
that any even order symmetric double B-tensor B has an SOS tensor decomposition. Moreover, 
from Theorem 7 of [l^, we know that, for any symmetric MBg-tensor, it is either an M-tensor 
itself or it can be decomposed as the sum of an M-tensor and several positive multiples of partially 
all-one-tensors. As even order symmetric Af-tensors are positive semi-definite Z-tensors [45] which 
have, in particular, SOS decomposition, we see that any even order symmetric MBq tensor also 
has an SOS tensor decomposition. Combining these and noting that any quasi-double Bo-tensor 
is an MBo-tensor, we arrive at the following conclusion. 


Theorem 3.6 Even order symmetric double B-tensors, even order symmetric quasi double Bq- 
tensors and even order symmetric MBo-tensors all have SOS tensor decompositions. 


3.6 Even order symmetric //-tensors with nonnegative diagonal ele¬ 
ments have SOS decompositions 

In this part, we show that any even order symmetric iJ-tensor with nonnegative diagonal elements 
has an SOS tensor decomposition. Recall that an mth order n dimensional tensor A = (fliii 2 " jm)i 
it’s comparison tensor is defined by A4{A) = such that 

nflii-.-i — |ci2Z---A ^nd ’^ili2---im — I ^*1*2 "'^Tn 15 
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for all i,ii, ■ ■ ■ ,im S [n], ■ ■ ■ ,im) ^ I- Then, tensor A is called an i7-tensor [5] if there 

exists a tensor Z with nonnegative entries such that M.{A) = si — Z and s > p{Z), where X is 
the identity tensor and p{Z) is the spectral radius of Z defined as the maximum of modulus of 
all eigenvalues of Z. If s > p{Z), then A is called a nonsingular H-tensor. A characterization 
for nonsingular H-tensors was given in [ 6 ] which states is a nonsingular i7-tensor if and only if 
there exists an enteritis positive vector y = (yi, j/ 2 , • ‘ ‘ i ?/«) S K" such that 

Wii-’-ilUi > ^ ^ \^ii2---im.\yi2yi3 ' ' ' [n]. 

We note that the above definitions were first introduced in [B]. These were further examined in 
[mile] where the authors in |26j referred nonsingular _ff-tensors simply as i7-tensors and the 
authors in m referred nonsingular i7-tensors as strong i7-tensors. 

Theorem 3.7 Let A = (aiiia -im) a symmetric H-tensor with even order m dimension n. 
Suppose that all the diagonal elements of A are nonnegative. Then, A has an SOS tensor decom¬ 
position. 

Proof. We first show that any nonsingular i7-tensor with positive diagonal elements has an SOS 
tensor decomposition. Let A = (oiiia -im) be a nonsingular iL-tensor with even order m dimension 
n such that aii...i > 0, i G [n]. Then, there exists a vector y = (yi, • • • , yn)^ G K" with y^ > 0, 
f = 1, • • • , n, such that 

^ ^ ^ * ’ ’ yim J [u]. 

To prove the conclusion, by Lemma l2.11 we only need to prove 

/^(x) = ^ ^ > 0, V X e R". 

)eA^ 

From (13.21) . we know that 

/.a(x) > 'y ' I 'y ^ l®M 2 ---jm ly* yi2yi3 ' ' ' yim^i 1 ~ ^ ^ \^iii2---im\^iAi2 ' ' ' 

(3.3) 

Here, for any fixed tuple (i°, ‘ ‘ > *m) ^ assume ( 1 °, ‘ ‘ ) *m) is constituted by k dis¬ 
tinct indices jj*, ^ 2 , •• • , j)!, fc < to, which appear si, S 2 , •• • , Sfc times in respectively. 

Si € [m], I G [k]. Then, one has si -I- S 2 -I- • • • -I- Sfc = to. Without loss of generality, we denote 
a = \a^o^o...io I > 0. Let n{i°, i^, - ■ ■ , i^) be the set consisting of all permutations of {if, i^, - ■ ■ , *m)- 
So, on the right side of (13.3L there are some terms corresponding to the fixed tuple (fi,* 2 j ‘ ‘ ‘ Pm) 
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such that 


^ ^ Iz/jo 2 / 122/23 **’ 

(il .22,"- ,2m)G'ir(i5,2§,"- ,2^^) 

+ Y1 \ajOi^■■■iJy]['^y^2y^3■■■yimXfo 

,im)e7r(25,zO,--- , 2 ^) 


^ ^ I^i2*2---^7n 1 ^ 7 ? ^^2^*3 * * ‘ 

0 '°, 22 ,--- ,2m)e7r(z;,20,--- , 2 ^) 


a. 


E 

( 2 l, 22 ,"- , 2 m)e 2 r( 25 , 2 ^,--- , 2 ^^) 

m — l\ fm — siN fm — s\ — S 2 


2l 22 "■‘iTn 1^21 ^22 


* ^ 2 „ 


Si - 1 


S 2 


S3 


m — 1\ fm — S 2 \ f m — s\ — S 2 


S2 - 1 


Si 


S3 


m — Si — S 2 • • • — Sfc_i 
Sfc 

771 Si S2 * * * Sl^ — i 

Sk 


31 —272 32 3fc m 

ay 0 V o---V oX,o 

SjU WjU 


„,,32-272 31 33 

a/ZiO 2/„0 2/„0 2/,0 37 0 

32 31 33 Ifc 32 


+ 


fm — 1 

\Sk - 1 



/tTI - Sfc - Si 

V S2 


m - Sfc - Si • • • 

Sfe-l 


Sfe-2 


n,,sic-™„si . . . ,,*'"-1^222 

ay 0 y 0 y.-o 37 o 

Jfc ./l -/fc-l -'fc 


> 



m — Si — S 2 • ■ 


— Sk-1 


axfoX^I 

Jl J2 


■ - x. 


^-U 

■/fc 


(m- l)!ay"o'y^o' •••y^o*’ 

_ ./I ./2 _ 

si!s 2 ! • • • Sfc! 


Si 


VjI 


+ S 2 P 


Sk 




0 , 


where the last inequality follows the arithmetic-geometric inequality and the fact y > 0. Thus, 
each tuple ( 11 , 12 , • • • , im) S corresponds to a nonnegative value on the right side of (13.3|) . which 
implies that /(x) > 0 for all x € R". Hence, by Lemma [2.11 A has an SOS tensor decomposition. 

Now, let A he a general iL-tensor with nonnegative diagonal elements. Then, for each e > 0, 
At := ^ -I- el is a nonsingular iJ-tensor with positive diagonal elements. Thus, Ae —t A, and for 
each e > 0, Ae has an SOS tensor decomposition. As SOSm .22 is a closed convex cone, we see that 
A also has an SOS tensor decomposition and the desired results follows. □ 

In [71122], SOS decomposition of some classes of Hankel tensors was given. 


4 The SOS-Rank of SOS tensor Decomposition 

In this section, we study the SOS-rank of SOS tensor decomposition. Let us formally define 
the SOS-rank of SOS tensor decomposition as follows. Let A be a tensor with even order m 
and dimension n. Suppose A has a SOS tensor decomposition. As shown in Proposition 3.1, 
SOSm,n = SOS((j „ where SOSm_„ is the SOS tensor cone and SOS^ „ is the cone consisting of all 
777th-order n-dimensional symmetric tensors such that />t(x) := (A, x™) is a polynomial which can 
be written as sums of finitely many homogeneous polynomials. Thus, there exists r € N such that 
the homogeneous polynomial /^(x) = Ax™ can be decomposed by 

/^(x) = /i^(x) -H /a (x) H-h fri^), V X e R”, 

where /i(x), i G [r] are homogeneous polynomials with degree The minimum value r is called 
the SOS-rank of A, and is denoted by SOSrank(A). 
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Let C be a convex cone in the SOS tensor cone, that is, C C SOSm.n- We define the SOS-width 
of the convex cone C by 

SOS-width(C') = sup{SOSrank(^) : A G C}. 


Here, we do not care about the minimum of the SOS-rank of all the possible tensors in the cone C 
as it will be always zero. Recall that it was shown by Choi et al. in [H Theorem 4.4] that, an SOS 
homogeneous polynomial can be decomposed as sums of at most A many squares of homogeneous 
polynomials where 


VI + 8a — 1 

A =- and a = 


n -|- TO — 1 
TO 


(4.1) 


This immediately gives us that 


Proposition 4.1 Let A be a tensor with even order m and dimension n, m,n £ N. Suppose A 
has an SOS tensor decomposition. Then, its SOS-rank satisfies SOSrank(yl) < A, where A is given 
in |V1[ 1. In particular, SOS-width(SOSm,n) < A. 

In the matrix case, that is, to = 2, the upper bound A equals the dimension n of the symmetric 
tensor which is tight in this case. On the other hand, in general, the upper bound is of the order 
and need not to be tight. However, for a class of structured tensors with bounded exponent 
(BD-tensors) that have SOS decompositions, we show that their SOS-rank is less or equal to the di¬ 
mension n which is significantly smaller than the upper bound in the above proposition. Moreover, 
in this case, the SOS-width of the associated BD-tensor cone can be determined explicitly. To do 
this, let us recall the definition of polynomials with bounded exponent and define the BD-tensors. 
Let e G N. Recall that / is said to be a degree to homogeneous polynomials on R” with bounded 
exponent e if 


Q! Ct 

where 0 < < e and We note that degree 4 homogeneous polynomials on K” with 

bounded exponent 2 is nothing but the bi-quadratic forms in dimension n. Let us denote BD))^ 
to be the set consists of all degree to homogeneous polynomials on K" with bounded exponent e. 

An interesting result for characterizing when a positive semi-definite (PDF) homogeneous poly¬ 
nomial with bounded exponent has SOS tensor decomposition was established in [3] and can be 
stated as follows. 

Lemma 4.1 Let n G N with n > 3. Suppose e,m are even numbers and to > 4. 

(1) If n> A, then BD^ ^ 0 PSDm.n V SOSm,™ if and only if m> en — 2; 

(2) If n = 3, then BD))j „ 0 PSDm^„ C SOSm,n if and only if m = A or m > 3e — A. 

Now, we say a symmetric tensor is a BD-tensor with order to, dimension n and exponent e 
if /(x) = Mx™ is a degree to homogeneous polynomial on R” with bounded exponent e. We also 
define BD^.n to be the set consisting of all symmetric BD-tensors with order to, dimension n and 
exponent e. It is clear that BD^ n is a convex cone. 

Theorem 4.1 Let n G N with n > 3. Suppose e,m are even numbers and m > A. Let A be 

a BD-tensor with order to, dimension n and exponent e. Suppose that A has an SOS tensor 

decomposition. Then, we have SOSrank(yl) < n. Moreover, we have 

SOS-width(BD^ „ fl SOSm.n) = 


f 1 if m = en 
\ n otherwise. 
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Proof. As is a BD-tensor and it has SOS decomposition, the preceding lemma implies that 
either (i) n > 4 and m > en — 2 (ii) n = 3 and m = 4 and (hi) n = 3 and m > 3e — 4. We now 
divide the discussion into these three cases. 

Suppose that Case (i) holds, i.e., n > 4 and m > en—2. From the construction, we have m < en. 
If m = en, then A has the form axf ■ ■ ■ xf. Here, a > 0 because A has SOS decomposition and e 
is an even number. In this case, SOSrank(^) = I. Now, let m = en — 2. Then, 


V(*b)eF 

for some G K., (*, j) € F and for some F C {I, • • • , n} x {I, • • • , n}. As e is an even number 
and A has SOS decomposition, we have 

OijXf^xJ^ > 0 for all Xi 0 and Xj ^ 0. 

(*b)eF 



Thus, by continuity, An) = j)^F ^ positive semi-definite quadratic form, 

and so, is at most sums of n many squares of linear functions in H, • • • , Let Q(ti, • • • , t„) = 
Sfe=i [Qk{ti, ■ ■ ■ An)] where qk are linear functions. Then, 



Note that 

[qkixf\--- ,x-^)f = 

is a square. Thus, SOSrank(^) < n in this case. 

Suppose that Case (ii) holds, i.e., n = 3 and rn = 4. Then by Hilbert’s theorem m, 
SOSrank(^) < 3 = n. 

Suppose that Case (hi) holds, i.e., n = 3 and m > 3e — 4. In the case of m = en — 2 = 3e — 2 
and m = en = 3e, using similar argument as in the Case (i), we see that the conclusion follows. 
The only remaining case is when m = 3e — 4. In this case, as ^ is a BD-tensor with order m, 
dimension 3 and exponent e and A has SOS decomposition, we have 


™ ™ 1 1 

■■■x^qk{xf ,••• ,x~ ) 


Ax™ 


xlx^xlG{x^ \x2 \x^ y. 


where G is a positive semi-definite form and is of 3 dimension and degree 4. It then from Hilbert’s 
theorem |13j that G(tiA 2 yt 3 ) can be expressed as at most the sum of 3 squares of 3-dimensional 
quadratic forms. Thus, using similar line of argument as in Case (i) and noting that e > 4 (as 
m = 3e — 4 and m > 4), we have SOSrank(A) < n = 3. 

Combining these three cases, we see that SOSrank(A) < n, and SOSrank(A) = I if m = en. 
In particular, we have SOS-width(BD^ 0 SOS^.n) < n, and SOS-width(BD^ 0 SOS^.n) = 1 if 
m = en. To see the conclusion, we consider the homogeneous polynomial 

( xf - ■ ■ a;® (X)r=i ^i~^) if n > 3 and m = en — 2 

/o(x) = < x‘lx 2 + + xfx^ if n = 3 and m = 4 

[ xlx 2 X^{xf^xf^ -I- xf^xf^ + xf^xf^) if n = 3 and m = 3e — 4 

and its associated BD-tensor Aq such that fo (x) = AqX™ . It can be directly verified that 


SOSrank(Ao) 


n if n > 3 and m = en — 2, 

3 if n = 3 and m = 4, 

3 if n = 3 and to = 3e — 4. 
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For example, in the case n > 3 and m = en — 2, to see SOSrank(^o) = n, we only need to 
show SOSrank(^o) > n. Suppose on the contrary that SOSrank(^o) < n — 1 . Then, there exists 
r < n — 1 and homogeneous polynomial fi with degree to /2 = — 1 such that 

C n \ r 

i=l / i=l 

This implies that for each x = (xi, • • • , x„) with 7 ^ 0, i = 1, • • • , n 

n r V 

i=l i=l L^l ' ' ' _ 

Letting ti = x~^, by continuity, we see that the quadratic form written as a sum of 

at most r many squares of rational functions in (ti,, • • • , t„). Then, the Cassels-Pfister’s Theorem 
[SI Theorem 17.3] (see also [SI Corollary 17.6]), implies that the quadratic form ^e 

written as a sum of at most r many sums of squares of polynomial functions in (ti,, • • • ,tn), which 
is impossible. 

In the case n = 3 and to = 4, we only need to show SOSrank(^o) ^ 3. Suppose on the contrary 
that SOSrank(^o) < 2 . Then, there exist a^, bi, Ci, di, e^, /i S K., * = 1 , 2 , such that 

xfx 2 +X 2 x'^+X^Xi = {aiXi + biX 2 + CiX^ + diXiX 2 + € 1 X 1 X 3 + f 1 X 2 X 3 )^ 

+ {a 2 xl + b 2 xl + C 2 xl + d 2 XiX 2 + € 2 X 3 X 3 + f2X2X3Y. 

Comparing with the coefficients gives us that oi = 02 = 61 = &2 = ci = C 2 = 0 and 

dl+ dl = 1 

ef + e| = 1 

^ /f + /l = l 

diei + d 2€2 = 0 
difi + ^ 2/2 = 0 
€lfl + 62/2 = 0 . 

From the last three equations, we see that one of di, d 2 , ei, 62 , /i, /2 must be zero. Let us assume 
say di = 0. Then, the first equation shows d 2 = ±1 and hence, 62 = 0 (by the fourth equation). 
This implies that ei = ±1 and /2 = 0. Again, we have /i = ±1 and hence 

€lfl + 62/2 = (± 1 )(± 1 ) + 0 = ±1 7 ^ 0 . 


This leads to a contradiction. 

For the last case, suppose again by contradiction that SOSrank(Ao) < 2 . Then, there exist two 
homogeneous polynomial fi with degree to/2 = ^ — 2 such that 

2 

xlx^2xl{xf^xf'^ + xf^xf^ + xf'^xf'^) = Y2 

i=l 

This implies that for each x = {xi, • • • , Xn) with Xi ^ 0, i = 1, ■ ■ ■ , n 

2 

-2 -2 , -2 -2 , -2 -2 
X3 X2 X2 X3 + X3 X3 — / . 

i=l 

Letting ti = x~^, using a similar line argument in the case to = en — 2, we see that the polynomial 
+^ 2^3 + ^ 3^1 can be written as sums of 2 squares of polynomials in (ti, ^ 2 ; ^ 3 )- This is impossible 
by the preceding case. Therefore, the conclusion follows. □ 


M^) 

^ _e 

'r* 2 . . . ^ 2 

*^3 
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Below, let us mention that calculating the exact SOS-rank of SOS tensor decomposition is 
not a trivial task even for the identity tensor, and this relates to some open question in algebraic 
geometry in the literature. To explain this, we recall that the identity tensor X with order m and 
dimension n is given by In-*™ = 1 ii ii = ■ ■ ■ = and = 0 otherwise. The identity 

tensor I induces the polynomial /i(x) = Ix™ = -I- • • • -I- x™. It is clear that, I has an 

SOS tensor decomposition when m is even and the corresponding SOS-rank of X is less than or 
equal to n. It was conjectured by Reznick [40] that /i(x) cannot be written as sums of (n — I) 
many squares, that is, SOSrank(I) = n. The positive answer for this conjecture in the special 
case of m = n = 4 was provided in [331133] . On the other hand, the answer for this conjecture 
in the general case is still open to the best of our knowledge. Moreover, this conjecture relates 
to another conjecture of Reznick m in the same paper where he showed that the polynomial 
/fl;(x) = Xi +■ —hx” — nxi ■ ■ ■ Xn Can be written as sums of {n—1) many squares whenever n = 2^' 
for some fc £ N, and he conjectured that the estimate of the numbers of squares is sharp. Indeed, 
he also showed that this conjecture is true whenever the previous conjecture of “/x(x) cannot be 
written as sums of {n — 1) many squares” is true. 

5 Applications 

In this section, we provide some applications for the SOS tensor decomposition of the structure ten¬ 
sors such as finding the minimum i7-eigenvalue of an even order extended Z-tensor and testing the 
positive definiteness of a multivariate form. We also provide some numerical examples/experiments 
to support the theoretical findings. Throughout this section, all numerical experiments are per¬ 
formed on a desktop, with 3.47 GHz quad-core Intel E5620 Xeon 64-bit CPUs and 4 GB RAM, 
equipped with Matlab 2015. 

5.1 Finding the minimum //-eigenvalue of an even order symmetric ex¬ 
tended Z-tensor 

Finding the minimum eigenvalue of a tensor is an important topic in tensor computation and 
multilinear algebra, and has found numerous applications including automatic control and image 
processing m- Recently, it was shown that the minimum iJ-eigenvalue of an even order symmetric 
Z-tensor |151114] can be found by solving a sums-of-squares optimization problem, which can be 
equivalently reformulated as a semi-definite programming problem, and so, can be solved efficiently. 
In |15j . some upper and lower estimates for the minimum iJ-eigenvalue of general symmetric tensors 
with even order are provided via sums-of-squares programming problems. Examples show that the 
estimate can be sharp in some cases. 

On the other hand, it was unknown in [141115] that whether similar results can continue to 
hold for some classes of symmetric tensors which are not Z-tensors, that is, for symmetric tensors 
with possible positive entries on the off-diagonal elements. In this section, as applications of the 
derived SOS decomposition of structured tensors, we show that the class of even order symmetric 
extended Z-tensor serves as one such class. To present the conclusion, the following Lemma plays 
an important role in our later analysis. 

Lemma 5.1 1*^^ Let A be a symmetric tensor with even order m and dimension n. Denote the 
minimum H-eigenvalue of A by XminiA). Then, we have 

Ax™ 

Amm(A) = min—-—= min Ax™, (5.1) 

-^0 ||x||™ ||x|U = l 

where ||x|U = (E^i 
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Theorem 5.1 (Finding the minimum il-eigenvalue of an even order symmetric ex¬ 
tended Z-tensor) Let m be an even number. Let A be a symmetric extended Z-tensor with order 
m and dimension n. Then, we have 

Amin(^) = niax{/x :/^(x)-r(||x||™ - 1) -€ S^[x]}, 

where /. 4 (x) = ylx™ and S^[x] is the set of all SOS polynomials with degree at most m. 

Proof. Consider the following problem 


(P) minMx™:||xC = l} 


and denote its global minimizer by a = (oi,--- ,anY' G Clearly, — 1- Then, 

Amin(-4) = /^(a) = Aa."^. It follows that for all x € R"’\{0} 

n n 

/^(x) - Amin(Al) 




1=1 


'(Er=i^r) 


-) - /.4(a) > 0, 


where the last inequality holds as m is even and x =- - -^ belongs to the feasible set of (P). 

(^i = l ^ 

This shows that g{x) := /^(x) — Amin(-4) a homogeneous polynomial which always take 

nonnegative values. As A is an extended Z-tensor, there exist s G N and index sets P; C {1, • • • , n}, 
1 = 1 , • • • , s with P; = { 1 , • • • ,n} and Pq fl ri 2 =0 such that for all x G R" 


/.4(x) = fm,iX^ + X! (^-2) 

i=l 1=1 Oil 


such that, for each I = 1, - ■ ■ , s, either one of the following two condition holds: ( 1 ) /a, = 0 for all 
but one a; G flj; (2) fa, < 0 for all a; G fl;. Thus, 


^(x) = - Amin(Al))x™ Y 

i=l 1=1 cti GO,i 


is an extended ^-polynomial which always takes nonnegative values. Let S be a symmetric tensor 
such that g{x) = Sx"*. Then, P is a positive semi-definite extended Z-tensor and so is SOS 
by Theorem 13.41 Thus, g{x) is an SOS polynomial with degree m. Note that g{x) = /^(x) — 
Amin(Al) X)r=i = /. 4 (x) - Amin(Al)(X)r=i - Amin(Al) . This shows that 

Amin(4l) < max{/x : /^(x) - r(||x||);) - 1) - /r G EmW}- 


To see the reverse inequality, take any (^,r) with /^(x) — r(||x||™ — 1) — /r G Then, for all 

X G R”, 

/_4(x) -r-(||x|l™ - 1) - M > 0. 

This shows that r > fi and /. a ( x ) > r||x||))) for all x G R”. This shows that Amin(.4) > r > fi, and 
so, the conclusion follows. □ 
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Remark 5.1 Let A be an extended Z-tensor. As in iS.Si) . its associated polynomial can he 
written as /^(x) = X;r=i + Ef=i Ea,en, ■ Then, Remark \3.1\ imvlies that 

Amin(.A) = max{/i :/^(x)-r(||x||™ - 1) -/X G E^[x]} 

= max{/x : /^(x) -r||x||™ G S^[x],r-/x > 0} 

fj.,r£K 

= max{n :fm,ixT + Hm € E^[x(')], Z = 1 , • • • , s 

ieFi ai^Vti 

r — /X > 0} 

where, for each I = 1, - ■ ■ ,s, x*^*) = {xi)i^ri and E^[x*^*)] is the set of all SOS polynomials in x^*^ 
As explained in mui], the sums-of-squares problem 

max{/x : /^(x) - r(||x||™ - 1) - ^ G E^[x]} 

can be equivalently rewritten as a semi-definite programming problem (SDP), and so, can be solved 
efficiently. Indeed, this conversion can be done by using the commonly used Matlab Toolbox 
YALMIP [221 [3D]. On the other hand, the size of the equivalent SDP problem of the relaxation 
problem increase dramatically when the dimension/order of the tensor increases. For example, as 
illustrate in Table 1, for a 4th-order 50-dimensional tensor, the equivalent SDP problem has 1326 
variables and 316251 constraints. Fortunately, a robust SDP software (SDPNAL [3^) has been 
established recently which enables us to solve large-scale SDP (dimension up to 5000 and number 
of constraint of the SDP up to 1 million). This enables us to find the minimum R-eigenvalue for 
medium-size tensor. Later on, we will explain how to use SDPNAL together with the observation 
in Remark 1 5. II to find the minimum iL-eigenvalue for large-size tensor. 

We first illustrate how to compute the minimum iL-eigenvalue of an extended Z-tensor A 
using the above sums-of-squares problem via Matlab Toolbox YALMIP IMIISD] via two small-size 
problems. We will show the performance of the method for various larger-size problem later. 

Example 5.1 Consider the symmetric tensor A with order 6 and dimension 4 where 

Allllll = ^222222 = A333333 = A444444 = 1, 

Aq-.-je = i, for all (n,--- ,X6 ) = cr(l, 1,1, 2, 2, 2), 

2 

Ai^...^s = -, for all (xi, • • • , xe) = cr(3,3,4,4,4,4), 

and Ai^...ig = 0 otherwise. Here aiii,--- , xe) denotes all the possible permutation of (ii,--- ,ie). 
The associated polynomial 

/^(x) = Ax™ = x^ + X2 + + 4 x^X 2 + 60:3X4 

is an extended Z-polynomial. So, A is an extended Z- tensor. It can be easily verified that A is 
not a Z-tensor. 

To compute its minimum H-eigenvalue, we note that the corresponding sums-of-squares opti¬ 
mization problem reads 

max{/x : /^(x) - r(||x||^ - 1) - /x G E^[x]}. 

Convert this sums-of-squares optimization problem into a semi-definite programming problem using 
the Matlab Toolbox YALMIP JEtA \3(Jf . and solve it by using the SDP software SDPNAL we obtain 
that (A) = — 1. The simple code using YALMIP is appended as follows: 
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sdpsettings( ’ solver ’,’ sdpnal ’) 
sdpvar xl x2 x3 x4 r mu 

f = xl~6+x2"6+x3"6+x4~6+4*xl"3*x2"3+6*x3~2*x4~4; 
g= [(xl'6+x2'6+x3'6+x4"6)-l]; 

F = [sos(f-mu-r*g)]; 
solvesos(F,-mu,[],[r;mu]) 

Moreover, note from the geometric mean inequality that = ( 2 ^ 1 )^ ( 2 ^ 2 )^ ^ 

follows that 

/^(x) + ||x||g = 2a;® + 2x2 + + 4a;®a;^ + 6 a; 3 a ;4 > 0 for all x G R”. 

On the other hand, consider x = [\J\, — \J\, 0, 0). We see that /^(x) + ||x||® = 0. This shows that 
Amin(-4) = min{/_ 4 (x) : ||x ||6 = 1} = —1. This verifies the correctness of our computed minimum 
H-eigenvalue. 


Example 5.2 Let q;,/3 G M and consider the symmetric tensor A with order 6 and dimension 4 
where 

-^llllll = -^222222 = '^333333 = -^444444 = 

Ai-ie = (*i, • • • fie)= 1,1, 2, 2, 2), 

Ai - ie = 13, for all (ii, • • • , * 6 ) = o-(3,3, 3,4,4,4), 

and = 0 otherwise. Here a{ii,--- fie) denotes all the possible permutation of (ii,--- fie). 

The associated polynomial 

fAi^) = .4x™ = X® + a;® + + a;® + 20a x^x^ + 20/3 x\x\ 


is an extended Z-polynomial. So, A is an extended Z- tensor. It can he easily verified that if either 
a > 0 or fi > 0, then A is not a Z-tensor. 

To compute its minimum H-eigenvalue, we randomly generate 100 instance of (a, /3) G [—5, 5] x 
[—5,5]. For each {a,f3), we convert the corresponding sums-of-squares optimization problem 

max{/a : /^(x) - r(||x||^ - 1) - /a G S^[x]} 

IT,r£K 

into a semi-definite programming problem using the Matlab Toolbox YALMIP f2fA \SOf . and solve it 
by using the SDP software SDPNAL. We then compare the computed minimum H-eigenvalue with 
the true minimum H-eigenvalue of A. Indeed, similar to the preceding example, we can verify that 
Amin(A) = m{a,f3) where 




l-10|a| if |a| > 1^1, 
1-101/3] tf la] <1/3]. 


For all the 100 generated {a,f3), the maximum difference of the computed H-minimum eigen¬ 
value and the true H-minimum eigenvalue is 6.2039e— 05. 


Medium-size examples 

We now consider a few medium-size examples which involves symmetric extended Z-tensor with 
order up to 30 or dimension up to 60 . 
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Example 5.3 Let m = 10k with k G N. Consider the symmetric tensor A with order m and 
dimension 4 where 



-4i 

■■■1 - 

II 

(N 

II 

CO 

CO 

II 

4 = 1, 



= a. 

for 

all (ii,- ■ 

•) ^m) — 








mf2 

m/2 

-^il •••im 

= /?, 

for 

all (ii, • • 

; ^m) — 

••• ,3,4, 

••• ,4), 






m/5 Amjb 

-^il ---im 

= /3, 

for 

all (ii, • • 

; ^m) — 

■ ■ ■ ,3,4, 

••• ,4), 


Amj^ m/5 

with a = 2 (^ 2 ) ^ P — “(r/zs) ^= 0 otherwise. Here < 7 (^ 1 , • • • , im) denotes all 
the possible permutation of (ii, - ■ ■ , im)- The associated polynomial 

mm m 4 m 4m m 

/. 4 (x) = Ax^ = a;™ + a;™ + a;™ + X™ + 2 xf xf — xf x/ — x-^ xf , 

is an extended Z-polynomial. So, A is an extended Z-tensor. It can be easily verified that A is 
not a Z-tensor. Moreover, using geometric mean inequality, we can directly verify that the true 
minimum H-eigenvalue is 0. 

We compute the minimum H-eigenvalue by solving the corresponding sums-of-squares problem 
for the case m = 20,30, and compare with the true minimum H-eigenvalue. The results are 
summarized in Table 1. 

Example 5.4 Let n = 4k with k € N. Consider the symmetric tensor A with order 4 and 
dimension n where 

Ami = -42222 = • • • = Annnn = n, 

1 Tl 

for all (ii, 12 ,, * 3 , u) = cr{4i - 3, 4i - 2, - 1, 4i), i = 1, • • • , 

D 4 

and = 0 otherwise. Here cr{ii, ■ ■ ■ , 14 ) denotes all the possible permutation of (ii, ■■ ■ , 14 ). 

The associated polynomial 

nj4: 

/^(x) = = n{Xi H-h x^) -h 4^X4i-3 X4i-1 X4i 

is an extended Z-polynomial. So, A is an extended Z-tensor. It can be easily verified that A is 
not a Z-tensor. Moreover, using geometric mean inequality, we can directly verify that the true 
minimum H-eigenvalue is n — 1. 

We compute the minimum H-eigenvalue by solving the eorresponding sums-of-squares problem 
for the case n = 20,40,50,60, and compare with the true minimum H-eigenvalue. The results are 
summarized in Table 1. 

The following table summarizes the numerical results of Example 5.3 and Example 5.4 where we 
compute the minimum iJ-eigenvalue by first converting the corresponding sums-of-squares problem 
to an SDP problem using YALMIP and solving this SDP problem using SDPNAL. In particular, 
the data of the following table are explained as follows. 

• m: the order of the symmetric tensor, 

• n: the dimension of the symmetric tensor, 

• NV: the number of variables of the equivalent SDP problem. 
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• NC: the number of constraints in the equivalent SDP problem, 

• Computed eigenvalue: the calculated minimum i/-eigenvalue, 

• True eigenvalue: the true minimum .//-eigenvalue 

• Time (YALMIP): the CPU-time for converting the sums-of-squares problem to SDP (mea¬ 
sured in seconds). 

• Time (SDPNAL): the CPU-time for solving SDP via SDPNAL (measured in seconds). 


Table 1: Test results for medium size tensors 


Problem 

m 

n 

NV 

NC 

Computed 

eigenvalue 

True 

eigenvalue 

Time (YALMIP) 

Time (SDPNAL) 

Example 5.3 

20 

4 

1001 

1001 

-1.7634e-09 

0 

11.9487 

0.5700 

Example 5.3 

30 

4 

3876 

6936 

1.1382e-12 

0 

198.8141 

8.2700 

Example 5.4 

4 

20 

231 

10626 

19.0000 

19 

4.6951 

0.4763 

Example 5.4 

4 

40 

861 

135751 

39.0000 

39 

440.8231 

1.7727 

Example 5.4 

4 

50 

1326 

316251 

49.0000 

49 

2365.9043 

5.1109 

Example 5.4 

4 

60 

1891 

635376 

59.0000 

59 

9322.0631 

50.2934 


We observe that, for all the above numerical examples, the minimum //-eigenvalues can be 
found successfully for medium-size tensors. 

5.2 Large size examples 

Finally, we illustrate with an example that using SDPNAL together with the observation in Remark 
O enables us to solve some large size tensors (dimension up to 2000). 

As one can observed in Table 1, most of the time are occupied in YALMIP in converting the 
sums-of-squares problem into an SDP problem. This process involves matching up the coefficients 
of all the involved many monomials, and so, can be time-consuming. On the other hand, 

by using the sums-of-squares problem discussed in Remark 15.11 and letting k = maxi<i<s jP/l, 
the corresponding process only involves many monomials which is much smaller than 

(™~rn~^) "'^hen s is large and k is small. For example, as in Example 5.4, we can set s = n/4, fc = 4 
and m = 4, and so, is of the order n; while = ("4^) which is of the order n^. 

The following table summarizes the numerical results of Example 5.4 with dimension from 500 
to 2000, where we compute the minimum //-eigenvalue by first converting the corresponding sums- 
of-squares problem discussed in Remark 15.11 to an SDP problem using YALMIP and solving this 
SDP problem using SDPNAL. We observe that, for all the instances, the minimum //-eigenvalues 
can be found successfully. The meaning of the data are the same as in Table 1. 
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Table 2: Test results for large size tensors 


Problem 

m 

n 

NV 

NG 

Gomputed 

eigenvalue 

True 

eigenvalue 

Time (YALMIP) 

Time (SDPNAL) 

Example 5.4 

4 

500 

1250 

1375 

499.0000 

499 

4.6299 

6.8295 

Example 5.4 

4 

1000 

2500 

2750 

999.0000 

999 

8.8298 

66.5566 

Example 5.4 

4 

2000 

5000 

5500 

1999.0000 

1999 

20.9729 

563.6903 


5.3 Testing positive definiteness of a multivariate form 

For a multivariate form we say it is positive definite if ytx™ > 0 for all x ^ 0. Testing 

positive definiteness of a multivariate form is an important problem in the stability study of 
nonlinear autonomous systems via Lyapunov’s direct method in automatic control m- Researchers 
in automatic control have studied the conditions of such positive definiteness intensively. However, 
for n > 3 and to > 4, this is, in general, a hard problem in mathematics. Recently, some efficient 
methods based on eigenvalues of tensors were proposed to solve the problem in the case where 
TO = 4 [55] . 

In this part, we show that testing positive definiteness of a multivariate form Ax^ where A is 
an extended Z-tensor can be computed by sums-of-squares problem via Theorem 15.11 Indeed, a 
direct consequence of Theorem 15.II and Lemma 15.II give us the following useful test: 

Corollary 5.1 Let A be an extended Z-tensor. Then, the associated multivariate form Ax"^ is 
positive definite if and only if 

max{^ : /^(x) - r(||x||™ - 1) - ^ G > 0, 

where /.a(x) = Ax^ and of all SOS polynomials with degree at most to. 

We now use the above corollary to test the positive definiteness of extended Z-tensors. To do 
this, we first generate 100 extended Z-tensors as numerical examples. These extended Z-tensors 
are randomly generated by the following procedure. 


Procedure 1 


(i) Given (to, n, s, k, M) with to is an even number and n = sk, where n and to are the dimension 
and the order of the randomly generated tensor, respectively, and M is a large positive 
constant. 


(ii) Randomly generate a random positive integer L and a partition of the index set {1, • • • , n}, 
{Ti,--- jTs}, such that [Til = k, i = I,-- - ,s and L^ fl L^/ = 0 for all i i'. For each 
i = I,-- - ,s — 1, generate a random multi-index {l\,--- ,11^) with G F^, j = I,-- - ,to 
and a random number G [0,1]. Generate one randomly TOth-order fc-dimensional 

symmetric tensor B, such that all elements of B are in the interval [0,1]. 


(hi) We define extended Z-tensor A = (aiii2"'im) such that 


(-l)^M if 


if 


if 




= • • • = Zm = * for alH = 1, • • • , n, 

(*!,• •• Am) = cr{l\,--- ,0 with ll,--- ,L^Gri,i = !,■■■ ,s - 1, 
f 1; * * * 5 im G Fg, 


0 othewise. 

Here cr(zi, • • • , im) denotes all the possible permutation of (zi, • • • , im)- 
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From the construction of A, it can be verified that A is an extended Z-tensor. Let /^^(x) = 
Ax"^. We then solve the sums-of-squares problem 

max{/i : /^(x) - r(||x||;;^ - 1) - ^ e 

and use the preceding corollary to determine whether Ax"^ is a positive definite multivariate form 
or not. Here, to speed up the algorithm, as we did for the large size tensors, we first convert 
the sums-of-squares problem into an SDP by using Remark l5.II and YALMIP. Then, we solve the 
equivalent SDP by using the software SDPNAL. The correctness can be verified by looking at the 
randomly generated positive number L. Indeed, from the construction, if L is an even number 
and M is a large positive number, the diagonal elements will strictly dominate the sum of the 
off-diagonal elements, and so, Ax™ is a positive definite multivariate form. On the other hand, if 
L is an odd number, then the diagonal elements will be negative, and so. Ax™ is not a positive 
definite multivariate form in this case. 

The following table summarize the results for the correctness of testing the positive definiteness 
of a multivariate form generated by an extended Z-tensor. As we can see the results, in our 
numerical experiment, all the 100 randomly generated instance has been correctly identified. 


m 

n 

S 

k 

M 

PD 

NPD 

Correctness 

4 

20 

4 

5 

100 

48 

52 

100% 

4 

25 

5 

5 

100 

46 

54 

100% 

4 

40 

4 

10 

100 

52 

48 

100% 

4 

60 

4 

15 

100 

45 

55 

100% 

4 

100 

4 

25 

100 

44 

56 

100% 


6 Conclusions and Remarks 

In this paper, we establish SOS tensor decomposition of various even order symmetric structured 
tensors available in the current literature. These include positive Cauchy tensors, weakly diag¬ 
onally dominated tensors, i?o-tensors, double H-tensors, quasi-double i?o-tensors, MBo-tensors, 
iL-tensors, absolute tensors of positive semi-definite Z-tensors and extended Z-tensors. We also 
examine the SOS-rank of SOS tensor decomposition and the SOS-width for SOS tensor cones. In 
particular, we provide an explicit sharp estimate for SOS-rank of tensors with bounded exponent 
and SOS-width for the tensor cone consisting of all such tensors with bounded exponent that have 
SOS decomposition. It is shown that the SOS-rank of SOS tensor decomposition is equal to the 
optimal value of a related rank optimization problem over positive semi-definite matrix constraints. 
Finally, applications for the SOS decomposition of extended Z-tensors are provided and several 
numerical experiments illustrate the significance. 

Below, we raise some open questions which might be interesting for future work: 

Question 1: Can we evaluate the SOS-rank of symmetric Bp-tensors? 

Question 2: Can we evaluate the SOS-rank of symmetric Z-tensors? 

Question 3: Can we evaluate the SOS-rank of symmetric diagonally dominated tensors? 

Question 4: Can we use the techniques in Section 5 to find the minimum iJ-eigenvalue of an 
even order symmetric structured tensors other than the extended Z-tensors? 

Acknowledgment We are thankful to Prof. Man-Duen Choi, Prof. Changqing Xu, Dr. Xin Liu 
and Dr. Ziyan Luo for their comments, which improved our paper. 


26 












References 


[1] A. Anandkumar, R. Ge, D. Hsu, S. Kakade, M. Telgarsky, Tensor decompositions for learning 
latent variable models, Journal of Machine Learning Research 15 (2014) 2773-2832. 

[2] H. Chen, L. Qi, Positive Definiteness and Semi-Definiteness of Even Order Symmetric Cauchy 
Tensors, Journal of Industrial and Management Optimization 11 (2015) 1263-1274. 

[3] M.D. Choi, T.Y. Lam, Extremal positive semi-definite forms, Mathematische Annalen 231 
(1977) 1-18. 

[4] M.D. Choi, T.Y. Lam, B. Reznick, Sums of squares of real polynomials. In Proceedings of 
Symposia in Pure mathematics, American Mathematical Society 58 (1995) 103-126. 

[5] P. Comon, Tensors: a brief introduction, IEEE Signal Processing Magazine 31.3 (2014) 44-53. 

[6] W. Ding, L. Qi, Y. Wei, M-Tensors and Nonsingular M-Tensors, Linear Algebra Appl. 439 
(2013) 3264-3278. 

[7] W. Ding, L. Qi, Y. Wei, Inheritance Properties and Sum-of-Squares Decomposition of Hankel 
Tensors: Theory and Algorithms, September 2015, arXiv:1505.02528v3. 

[8] R.S. Elman, N. Karpenko, A. Merkurjev, The Algebraic and Geometric Theory of Quadratic 
Porms, American Mathematical Society, Colloquium Publications, 56 (2008). 

[9] C. Fidalgo, A. Kovacec, Positive semi-definite diagonal minus tail forms are sums of squares, 
Mathematische Zeitschrift 269 (2011) 629-645. 

[10] M. Fiedler, Notes on Hilbert and Cauchy matrices, Lin. Alg. Appl., 432 (2010), 351-356. 

[11] A. S. Field, D. Graupe, Topographic component (parallel factor) analysis of multichannel 
evoked potentials: practical issues in trilinear spatiotemporal decomposition. Brain Topography 
3(4) (1991) 407-423. 

[12] W. Habicht, Uber die Zerlegung strikte definiter Formen in Quadrate, Commentarii Mathe- 
matici Helvetici 12(1) (1939) 317-322. 

[13] D. Hilbert, Uber die Darstellung definiter Formen als Summe von Formenquadraten, Mathe¬ 
matical Annals 32 (1888) 342-350. 

[14] S. Hu, G. Li, L. Qi, A tensor analogy of Yuan’s alternative theorem and polynomial op¬ 
timization with sign structure. Journal of Optimization Theory and Applications DOI; 
10.1007/sl0957-014-0652-l. 

[15] S. Hu, G. Li, L. Qi, Y. Song, Finding the maximum eigenvalue of essentially nonnegative 
symmetric tensors via sum of squares programming, Journal of Optimization Theory and 
Applications 158 (2013) 717-738. 

[16] E.L. Kaltofen, B. Li, Z. Yang, L. Zhi, Exact certification in global polynomial optimization via 
sums-of-squares of rational functions with rational coefficients. Journal of Symbolic Compu¬ 
tation 47 (2012) 1-15. 

[17] M.R. Kannan, N. Shaked-Monderer, A. Berman, Some properties of strong H-tensors and 
general H-tensors, Linear Algebra and its Applications 476 (2015) 42-55. 


27 


[18] T. Kolda, B. Bader, The tophits model for higher-order web link analysis, In Workshop on 
link analysis, counterterrorism and security, Vol. 7, 2006. 

[19] T. Kolda, B. Bader, Tensor decompositions and applications, SIAM review 51.3 (2009) 455- 
500. 

[20] T. Kolda, J. Sun, Scalable tensor decompositions for multi-aspect data mining, In ICDM, 2008. 

[21] J.B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM Jour¬ 
nal on Optimization 11 (2011) 796-817. 

[22] M. Laurent, Sum of squares, moment matrices and optimization over polynomials. Emerging 
Applications of Algebra Geometry, Vol. 149 of IMA Volumes in Mathematics and its Appli¬ 
cations, M. Putinar and S. Sullivant eds.. Springer, (2009) 157-270. 

[23] T.H. Le, M. Van Barel, An algorithm for decomposing a non-negative polynomial as a sum of 
squares of rational functions. Numerical Algorithms (2014) 1-17. 

[24] C. Li, Y. Li, Double B tensors and quasi-double B tensors, Linear Algebra Appl. 466 (2015) 
343-356. 

[25] C. Li, L. Qi, Y. Li, MB-tensors and MB^-tensors, Linear Algebra Appl. 484 (2015) 141-153. 

[26] C. Li, F. Wang, J. Zhao, Y. Zhu, Y. Li, Criterions for the positive definiteness of real super- 
symmetric tensors, Journal of Computational and Applied Mathematics 255 (2014) 1-14. 

[27] G. Li, L. Qi, Y. Xu, SOS Hankel Tensors: Theory and Application, October 2014, 
arXiv:1410.6989, 

[28] L.-H. Lim, Singular values and eigenvalues of tensors: a variational approach, in Proceedings 
of the IEEE International Workshop on Computational Advances in Multi-Sensor Addaptive 
Processing (CAMSAP-05) 1 (2005) 129-132. 

[29] J. Ldfberg, YALMIP : A Toolbox for Modeling and Optimization in MATLAB, In Proceedings 
of the CACSD Conference, Taipei, Taiwan, 2004. 

[30] J. Lofberg, Pre- and post-processing sums-of-squares programs in practice, IEEE Tran, on 
Auto. Gout. 54 (2009) 1007-1011. 

[31] Z. Luo, L. Qi, Y. Ye, Linear operators and positive semidefiniteness of symmetric tensor 
spaces. Science China Mathematics 58 (2015) 197-212. 

[32] Z. Luo, L. Qi, N. Xiu, The sparsest solutions to Z-tensor complementarity problems, 
arXiv:1505.00993 (2015). 

[33] Q. Ni, L. Qi, F. Wang, An eigenvalue method for testing the positive definiteness of a multi¬ 
variant form, IEEE Trans. Automat. Control 53 (2008) 1096-1107. 

[34] J. Nie, Sum of squares method for sensor network localization. Computational Optimization 
and Applications 43 (2009) 151-179. 

[35] P.A. Parrilo, Semi-definite programming relaxations for semialgebraic problems. Math. Pro¬ 
gram. Ser.B 96 (2003) 293-320. 

[36] V. Powers, T. Wdrmann, An algorithm for sums of squares of real polynomials. Journal of 
pure and applied algebra 127 (1998) 99-104. 


28 


[37] L. Qi, Eigenvalue of a real supersymmetric tensor, J. Symb. Comput. 40 (2005) 1302-1324. 


[38] L. Qi, Y. Song, An even order symmetric B tensor is positive definite, Linear Algebra Appl. 
457 (2014) 303-312. 

[39] L. Qi, C. Xu, Y. Xu, Nonnegative tensor factorization, completely positive tensors and an 
hierarchical elimination algorithm, SIAM Journal on Matrix Analysis and Applications 35 
(2014) 1227-1241. 

[40] B. Reznick, A quantitative version of Hurwitz’s theorem on the arithmetic-eometric inequality, 
J. Reine Angew. Math. 377 (1987) 108-112. 

[41] B. Reznick, Some concrete aspects of Hilbert’s 17th problem, Contemporary Mathematics 253 
(2000) 251-272. 

[42] N. Shor, Nondifferentiable Optimization and Polynomial Problems, Kluwer Academic Publi¬ 
cations, Bosten, 1998. 

[43] P. Yiu, The length of x\ -\- X 2 -\- x'^-\- x\ as a sum of squares. Journal of Pure and Applied 
Algebra 23 (2001) 367-373. 

[44] D. Zhang, An elementary proof that the length of x\x\x\x\ is 4, Journal of Pure and 
Applied Algebra 193 (2004) 307-311. 

[45] L. Zhang, L. Qi, G. Zhou, M-tensors and some applications, SIAM J. Matrix Anal. Appl. 35 
(2014) 437-452. 

[46] X. Zhao, D. Sun, and K.C. Toh, A Newton-CG Augmented Lagrangian Method for Semidefinite 
Programming, SIAM J. Optimization 20 (2010) 1737-1765. 


29 


